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Abstract 



We generalize Gaspard's method for computing the e-entropy production 
CN ■ rate in Hamiltonian systems to dissipative systems with attractors considered 

, earlier by Tel, Vollmer, and Breymann. This approach leads to a natural 

' definition of a coarse grained Gibbs entropy which is extensive, and which 

o ' 

■ graining sets which cover the attractor. One can also study the entropy and 

entropy production as functions of the degree of resolution of the coarse grain- 



ing process, and examine the limit as the coarse graining size approaches zero. 
We show that this definition of the Gibbs entropy leads to a positive rate of 
irreversible entropy production for reversible dissipative systems. We apply 
q ■ the method to the case of a two dimensional map, based upon a model con- 

sidered by Vollmer, Tel and Breymann, that is a deterministic version of a 
q . biased-random walk. We treat both volume preserving and dissipative ver- 

sions of the basic map, and make a comparison between the two cases. We 
discuss the e-entropy production rate as a function of the size of the coarse 
$_i ■ graining cells for these biased-random walks and, for an open system with 



flux boundary conditions, show regions of exponential growth and decay of 
the rate of entropy production as the size of the cells decreases. This work 
describes in some detail the relation between the results of Gaspard, those of 
of Tel, Vollmer and Breymann, and those of Ruelle, on entropy production in 
various systems described by Anosov or Anosov-like maps. 



I. INTRODUCTION 

Over the past few years, a great deal of attention has been devoted to the issues of 
entropy production in chaotic, thermostated systems subjected to external fields, Such 
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systems are often used in molecular dynamics simulations of irreversible processes in fluids, 
such as shear flows, or diffusive flows. The external field is used to provide a mechanism 
to establish a flow in the system, and the thermostat maintains a constant kinetic or total 
energy in the system, and produces a non-equilibrium, stationary state. The presence of 
the thermostat is felt in the dynamics of the particles of the system, which becomes, in the 
usual configuration and momentum variables, at least, a non-Hamiltonian, non-symplectic 
system || . The theoretical analyses of these thermostated systems has led to very interesting 
and fruitful connections between chaotic dynamics, transport coefficients, and irreversible 
thermodynamics, 

One of the results of this analysis is a relation between transport coefficients, such as the 
coefficient of shear viscosity or of diffusion, and the sum of all of the Lyapunov exponents of 
the system, |p|,|T0|. This sum, in contrast with that of a Hamiltonian, symplectic system, is 
not zero but is negative, and is proportional to the square of the external field strength, for 
small enough external fields. This connection is generally established by means of entropy 
production arguments, whereby two expressions for the irreversible entropy production in a 
thermostated system are set equal to each other. One of these expressions is just the usual 
relation between the irreversible entropy production per unit time, a, and the fluxes, Ji and 
forces, Xi, in an irreversible process, given by 

cr = ^2 Ji X i = LijXiXj. (1) 

i i,j 

Here we assumed that, for thermostated systems in small external fields, the fluxes, Ji, are 
related to the forces, Xj, through linear laws 

J i = ^2L ij X j . (2) 

3 

In Eqs. (|iyi), the quantities are the Onsager coefficients, which are directly related to 
the transport coefficients, and are supposed to form a positive definite matrix, so that the 
entropy production per unit time is positive |17j . The other of these two expressions for the 
entropy production is rather problematic. Usually one considers the time derivative of the 
Gibbs entropy, Sq, for the thermostated system, given by 

j t s G (t) = -jj dr>(r,t)[inp(r,t) - 1]. (3) 

Here T = (qi, ...,qNd,Pi, ■■■,PNd) is a point in the phase space of the system, and p(T,t) is 
the phase space density of the system. Here the qi,Pi, for 1 < i < Nd, are the configuration 
and momentum variables of a system of iV particles in d space dimensions. Because the 
system is no longer Hamiltonian, p no longer obeys the Liouville equation. However, p does 
obey a conservation equation of the form 



oqi dpi 



(4) 



with the usual "dot" notation for the time derivative of a dynamical variable. This con- 
servation equation can also be expressed in terms of the total time derivative of p{T,t) 

as 
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We will use this form below. 

As is well known, for a closed, Hamiltonian system, or one with periodic boundary 
conditions, the Gibbs entropy is constant in time, but for a thermostated system this is no 
longer true. Instead one finds, after using Eq. (||), and some partial integrations ||, that 



j t Sc(t)= JdTp(T,t)Y: 



dqj dpi 
dqi dpi 



(6) 



Here we have assumed that the phase space distribution function vanishes at all boundaries 
in configuration and momentum space. For a Hamiltonian system, the right hand side of Eq. 
(|) vanishes, but for a thermostated system, the divergence of the phase space velocity is not 
zero. The right hand side of Eq. (|B|) is easily related to the sum of the Lyapunov exponents 
of the system, by the following argument. We write the phase space density p(T, t) as 

where M is a fixed number of members of the ensemble in a small phase space volume, V(t). 
It then follows from the conservation equation, Eq. (|5|), that 



dp _ 



dqj | dpi 
dqi dpi 



d\nV(t) , s 

~ p dt' (8) 



Now the small phase space volume, V(t), changes with time as 

V(t)^V(0)exp[t (9) 

j 

where \j are the local Lyapunov exponents at the point in phase space where p is evaluated. 
It then follows immediately from Eqs. (0-0), that the rate of entropy production is given by 

dS G (t) 
dt 



/drp(r > t)x;A i (r) = E<- x i>. ( 10 ) 



and is negative whenever there is an average contraction of phase space volumes ! A very 
similar argument, using the Frobenius- Perron equation, shows that this conclusion is also 
valid for maps as well as for flows. This circumstance makes it difficult to equate the positive 
entropy production from irreversible thermodynamics to the negative change in the Gibbs 
entropy. 

This paradoxical situation is usually resolved in the literature, |]3|,|^JT6|] , by saying that 
the negative entropy production inside the system is compensated by a positive entropy 
production in the thermostat itself, so that the total entropy production per unit time of the 
[system + thermostat] is positive, or zero. One assumes that a non-equilibrium steady state 
is produced, eventually, in which the total entropy production in the [system + thermostat] 
is zero. Then the hypothetical (positive) entropy production in the thermostat is equated 



to the phenomenological (positive) entropy production, which produces the desired relation 
between the Lyapunov exponents and the transport coefficients. This procedure is not quite 
satisfactory for the following reasons: 

(1) One expects from phenomenological arguments that the rate of change of the local 
entropy, s(r), in a small region about a point r*can be decomposed into a term that represents 
the entropy flow into or out of the region plus a term that represents the local irreversible 
entropy production within the region. For thermostated systems one would like to represent 
the entropy flow term as the sum of two pieces, one representing the flow of entropy from 
neighboring regions due to physical currents, and another term representing the flow of 
entropy to or from the thermostat RI8| . This suggests that, for thermostated systems, the 
local entropy change should be written as 

ds _ d th s d e s djS 
dt~ dt dt dt' 

where the first term on the right hand side is identified with the local flow of entropy from 
the thermostat to the region. The second term, denoted by the subscript e, is the rate 
of flow of entropy into the region from its local environment, and the third term, denoted 
by the subscript i, is the local rate of irreversible entropy production in the region. In 
the analysis described in Eq. @ for thermostated systems, the thermostat appears in the 
equations of motion for the particles as a sort of dynamical friction which depends upon 
the phase point of the particles, and not as a source of a physical current of particles, 
momentum or energy into or from the system at the boundaries. By using continuous 
distribution functions as described above, one finds a negative rate of change of the total 
Gibbs entropy for the system, and one assumes there is a compensating positive entropy flow 
to the thermostat. The positive rate of change in the thermostat is then identified with the 
irreversible entropy production required by the Second Law. In this approach however there 
is no clear indentification of a positive irreversible entropy production within the system. 
Instead, the total entropy change in the system is due to the interaction with the thermostat, 
which lowers the entropy of the system, in effect, by reducing the phase space available to 
the system to a fractal attractor of lower information dimension than the phase space itself, 
as discussed below. 

(2) This last remark points to an additional, and perhaps deeper, problem with the anal- 
ysis given in Eq. (g), especially as it is applied to a system in a non-equilibrium stationary 
state. If we think of the approach of a thermostated system to a non-equilibrium steady 
state, then it is not surprising that the Gibbs entropy for the system decreases with time. 
That is, let us think of a positive entropy production as a loss of information about the 
system, and a negative entropy production as a gain of information about the system. Since 
the thermostat has the effect of creating an attractor in phase space, as time goes on the 
phase point of the system gets closer and closer to the attractor, J7|-|9| . Thus we learn more 
and more about the location of the phase point of the system as time increases, and this 
gain of information is reflected in a negative entropy change. However, as emphasized by by 
Breymann, Tel, and Vollmer pfl and by Gaspard this use of the Gibbs entropy supposes 



that we have some way to locate a phase point with arbitrary precision. Further, we have 
also assumed, in computing the rate of change of the Gibbs entropy, that the distribution 
function p(T, t) is a differentiable function. While this may be true as the system evolves 
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toward a steady state, it is no longer true in the steady state. Instead, for Anosov systems^ 
with phase space contraction, the phase space distribution becomes a singular SRB measure 
on the attractor with a smooth distribution in the unstable directions and a fractal structure 
in the stable directions. This type of distribution precludes the use of the ordinary calculus 
of differentiable functions, and requires a more careful analysis of the entropy production in 
the steady state. Therefore one cannot use differentiable functions to describe the distribu- 
tion function for the system in a non-equilibrium steady state, and the calculation leading 
to Eq. (|) is not correct. 

Gaspard [TP], in a study of the entropy production in open, Hamiltonian systems, pro- 



vided a method for analyzing the entropy production in a system with a phase space distribu- 
tion function that is, properly speaking, a singular measure. He considered a two-dimensional 
multi-baker map, constructed so as to allow diffusion of non-interacting particles in one space 
dimension. He then placed a high density reservoir at one end of the multi-baker chain, and 
a low density reservoir at the other end of the chain. The map then sets up a steady state 
in which a non-uniform density profile is established along the chain, and the phase space 
distribution for a particle in the chain, in the infinite system limit, is a nowhere differentiable 
SRB measure, smooth in the unstable direction, but fractal in the stable direction, see also 
P0fl . Since the properties of the SRB measure rule out the use of differentiable distribution 
functions, Gaspard constructed a so-called e-entropy, which can be thought of as a kind of 
coarse grained entropy, appropriate for singular, non-differentiable measures, provided the 
rate of entropy production is reasonably insensitive to the size of the coarse graining regions. 
Further, this system has no thermostat, and there is a clear separation of the local e-entropy 
change into a local e-entropy flow and a local irreversible ^-entropy production. The latter 
is positive, and for large systems, it depends on the density gradient in a way that agrees 
precisely with the laws of irreversible thermodynamics. 

Similarly, Vollmer et al. |18| considered a version of the multi-baker map which, though 
time reversible, is not volume preserving. They argued that their model has the same feature 
as one sees in thermostated systems, namely the contraction of the distribution function onto 
an attractor, and they used it to model the entropy production in a thermostated system. 
They considered the coarse grained entropy production in diffusive processes taking place 
in this system. Their analysis was based on a coarse graining procedure which uses larger 
coarse graining regions than that used by Gaspard |I9 |, but the results were very much 
the same. A positive production of the entropy was found and the form of this entropy 
production, in an appropriate macroscopic limit, agrees with the result one expects from 
nonequilibrium thermodynamics. Moreover, by comparing the results obtained for a volume 
preserving version of their model with those of the volume non-preserving version, they 
identified the effect of the thermostat on the rate of entropy production by looking at the 



As pointed out by Gallavotti and Cohen [13|, the assumption that the system be Anosov can be 
replaced by Anosov-like, which assumes that the flow be hyperbolic on a subset of the whole phase 
space that differs from it by a set of measure zero. For the purpose of this paper, the only property 
that we will require of Anosov-like systems is the existence of a generating partition, namely that 
the dynamics can be encoded in an unambiguous way by a sequence of symbols taken from a finite 
alphabet. 
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difference between the rates of entropy production in the two versions. 

What is perhaps most novel in the work of Gaspard and of Vollmer et al. is the fact that 
one now has a firm physical and mathematical reason for the coarse graining, namely the 
existence of underlying singular measures in phase space. Fractal structures in phase space 
also appear as the support for physical measures for Hamiltonian systems as well. The proper 
treatment of these phase space measures requires the use of coarse graining methods in more 
general cases than those considered here, of course. Moreover, in the proper description of 
many-particle systems, the use of coarse graining methods arise naturally when one goes 
from the Gibbs T-space description of the system, with a zero fine grained rate of entropy 
production, to the Boltzmann /i-space description involving reduced distribution functions 
pl|,|22| . However it requires an understanding of the hyperbolic nature of the many-particle 
system, and the structures in phase space along stable and unstable directions to understand 
why the reduced distribution functions, themselves, approach their equilibrium values in 
time, with a positive generation of entropy in the process [JHJ. 

To summarize : For both volume preserving systems driven out of equilibrium and volume 
non-preserving systems whose microscopic dynamics are described by Anosov-like systems, 
one should use a coarse grained entropy and entropy production to properly describe the 
system in a nonequilibrium steady state, since the distribution function is not smooth on 
any scale, no matter how fine. The use of a coarse grained entropy automatically involves a 
loss of information about the system since there is always a level of detail about the system 
which is inaccessible to the coarse grained description. This loss of information can then be 
identified with a positive irreversible entropy production. In the examples studied so far, this 
positive entropy production agrees, in the proper limit, with the predictions of irreversible 
thermodynamics. This agreement is ultimately the chief requirement of any microscopic 
definition of entropy production. Once one has a good microscopic definition of the rate of 
entropy production in a thermostated system, one can then try to identify the various terms 
in Eq. ( ITTJ ) with their microscopic counterparts. We are then provided with a means to 
identify the role of the thermostat in the production of entropy of the system. 

The purpose of this paper is to present a unified view of positive entropy production in 
both reversible, volume preserving and in reversible, volume "contracting" maps, which are 
time-discretized versions of thermostated dynamical systems. This paper can be considered 
to be a commentary upon and elaboration of work by Gaspard |19| and by Vollmer, Tel 



and Breymann |lq| . What is new here is the observation that Gaspard's e-entropy pro- 
cedure, when generalized appropriately, can be usefully applied to both Hamiltonian and 
thermostated systems, and that for the latter systems, there is much to be gained by a study 
of the effects of coarse graining on arbitrarily fine scales. In particular, we are able to relate 
the rate of irreversible entropy production to the difference of the entropies at two levels 
of resolution of the phase space, (see Eq. fl30D ), and for simple models we can explicitly 
evaluate the entropy production as a function of the level of resolution of the coarse graining 
procedure. Moreover, by carefully studying the effects of different levels of resolution, we 
can review and refine the relations described above between entropy production, Lyapunov 
exponents, and transport coefficients. This will allow us to make contact with recent work of 
Chernov et al. [||] and Ruelle ||], establishing rigorous results on the rate of entropy produc- 
tion in thermostated systems. Vollmer, Tel, and Breymann |23] have recently done related 
and complementary work on the effects of coarse graining in multi-baker models and on the 
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relation of their work with that of Gaspard, Chernov et al, and Ruelle. However, they do 
not look at the effects of making the coarse graining cells arbitrarily small, as we do here. 
We should also mention that while our work here does shed some further light on the nature 
of irreversible entropy production in simple thermostated systems, it does not answer a host 
of questions about the nature of entropy production in the more general setting of a many 
particle system with a large number of degrees of freedom. For such systems our results may 
be relevant for examining the rate of entropy production when the phase space distribution 
is projected onto a subspace of a few relevant variables. 

In the next section, we define a coarse grained, local entropy which is extensive and 
depends upon both the measure and the volume of each of the coarse graining regions in 
phase space. In section III we describe the rate of change of this coarse grained entropy in 
a nonequilibrium stationary state. We show that the rate of change of this local entropy 
is in fact zero in the steady state, but that it can be further decomposed in a way that 
is consistent with Eq. ( |TT| ) for dynamical systems with generating partitions, such as a 
Markov partition. In particular, this applies to those systems that satisfy Gallavotti and 
Cohen's chaotic hypothesis For systems where there is no flow of particles through 

the boundaries, and the distribution function vanishes at the boundaries, we derive, in 
section IV, a positive irreversible entropy production rate which is equal to the phase space 
contraction rate, in agreement with Chernov et al. and Ruelle Q. 

The general method discussed here is then applied to both volume preserving and volume 
contracting multi-baker chains, which represent deterministic models of biased random walks 
on a line. We show, in particular, that our definition of the entropy production leads 
to results consistent with those of Gaspard |19| , and with Vollmer et al. ||18|| , which we 
generalize to arbitrary resolution parameters. In particular, we show that, in its leading 
order, the entropy production rate for these maps increases exponentially as a function of 
the resolution parameter for a range of resolution parameters, and then, as the finite size 
effects start to interfere, falls exponentially to zero as the resolution gets finer and finer. We 
conclude with a discussion of a number of points raised by this work. 



II. GIBBS ENTROPY FOR CONTRACTING SYSTEMS 

We begin by considering a dynamical system defined by a map $ on a phase space X 
with invariant measure p. As discussed above, the Gibbs entropy for this system, if it were 
to be well-defined, would be given by Eq. (|j), as 

S a = -f dTp(r)pn(p(r))-l], (12) 

where the phase space density, p(T), at a point T, would be the derivative of the measure 
of a small region about T, 

That is, p would be the density of p, formally the Radon-Nikodym derivative of p with 
respect to the Liouville measure in phase space. However, as noted above, we must be 
cautious here, since the existence of a phase space density is only guaranteed for measures 
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that are absolutely continuous with respect to the Liouville measure. In particular, reversible 
systems in nonequilibrium steady states do not usually satisfy this requirement, especially, 
but not exclusively, if the system is dissipative with a contraction of phase space volumes. 
Therefore we cannot define the Gibbs entropy as in Eq. (|12|). Rather, we should define it as 



Sr 



fj,(dT) 



In 



/i(e£T) 
dT 



(14) 



To give this expression a clear meaning, we assume that our dynamical system admits a 



generating partition A (see for instance [24|) and define the (/, fc)-partition Ai tk as 

A ltk = <$>~ 1 {A) V $- l+1 (A) V ■ • • V $-\A) V A V $(A) V • • ■ V <$> k -\A) V <$> k -\A). 

That is, we suppose that there is some partition, A of the phase space into small, disjoint sets. 
We then consider forward iterations of these sets, which we denote by &(A), and backward 
iterations, which we denote by $>~i(A). The collection of very many sets denoted by Ai, k 
above is obtained by taking all possible intersections of the sets generated by iterating A 
forward in time over k — 1 steps and backwards in time by I steps. Here we use the standard V 
notation for indicating a partitioning of sets into the collection of all the possible intersections 
of all the indicated sets. For an element A of A\ k , we further define the corresponding volume 



u(A) = I dT X A(T), 
Jx 



(15) 



Xa(T) 



where 

'1, TEA, 
otherwise, 

is the characteristic function of A. 

We now define the (I, /c)-entropy of the triplet (X, $,//), with respect to the measures 
and volumes of the elements of this partition, by 



S l)k (X) 



AeAik 



log 



v{A) 



(16) 



where (i(A) is the steady state SRB measure of the set A. With our assumption that the 
partition A be generating, the elements of Ai jk shrink to points in the limit when both 
l,k — > oo. Hence 



lim S l>k 

4, re— >oo 



s, 



Gi 



(17) 



as defined in Eq. (|I4]). That is, we construct an extensive entropy for a particular refinement 
of our generating partition, and then define the Gibbs entropy to be the limit of the entropy, 
as the sets of the partition become more and more refined. From a physical point of view, 
it is expected that the limit in Eq. (|i~7D be independent of the choice of the partition, and 
this will indeed be the case for the case of a generating partition. In many cases, including 
those discussed here, the limit in Eq. (|T7| ) is negative infinity, since the measure of a set 
typically decreases more slowly than its volume as the coarse graining cells become small. 
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This occurs whenever the SRB measure is not absolutely continuous with respect to the 
Lebesgue measure, and the information dimension of the sets are smaller than their phase 
space dimension^ However, we will see subsequently that the rate of entropy production 
remains well defined as the coarse graining size approaches zero. 

There is a subtle limiting procedure being carried out here, that we wish to explain in 
more detail. If we allow the system to reach a non-equilibrium steady state, we can imagine 
that the measure p is an SRB measure which does not have a well defined density. However 
the measure and the volume of the elements of the partition are well defined, as is the 
entropy function S^k, for all I, k > 0. However, in the conventional approach to the Gibbs 
entropy for phase space distributions, one always assumes that the phase space density is 
well defined, in effect, assuming that the limit of an infinitesimally fine partition can be 
taken before the limit t — > oo, and that any non-equilibrium quantity based on that will be 
well defined in the non-equilibrium stationary state. The exchange of limiting processes is 
an essential feature of the correct treatment of entropy production in non-equilibrium steady 
states. 

Consider, now, a region B of X whose borders coincide with the borders of some elements 
of Avk'i for some V and k! . For all I > I' and k > k', we define the (/, /c)-entropy of B C X 
with respect to p by 



AeAi lk nB 



(18) 



In the next section, we derive the (I, fc)-entropy change in a time dependent picture and 
compare it to Eq. ([11]) in order to identify the various terms in the rate of change of the 
local entropy. 

III. COARSE GRAINED ENTROPY CHANGE 

In a time dependent picture, the evolution of the density p t is given by the action of the 
Frobenius- Perron operator, V. For an invertible map $, we have 



p t+l {Y)=Vp t {T) 



5^ 



Pt(®-\r)), (19) 



where the derivative in the third term indicates the Jacobian of $ _1 (r) with respect to T. 
Since the quantity pt is well defined for finite t, we will use it to construct the measures 
needed for the computation of the entropy, Si^{B), and entropy changes. The idea is to 
express the quantity p(A)/u(A) appearing in the logarithm on the right hand side of Eq. 
(|T8|) as a coarse grained density by means of the relation 

/,,M) - pM) = -At I. ft(T)dT. (20) 



v(A) rtv ' ~ v{A) J A 



2 We are indebted to P. Gaspard for this observation. 
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Let us now apply the Frobenius-Perron equation to the evolution of a coarse grained 
density p t (A) of some set A. Using Eq. (|19D , we have 



Pt+1 (A)^^J A Pt + i(T)dT, 
1 



v(A) J A 

1 



u(A) 



Pt(T)dT, 



u{A) 7$-i(A) 
1 



(21) 



Note that the definition of the measure pt{A), together with the Frobenius-Perron equation 
implies that 



p t+ M) = U®-\A)). 



(22) 



Now consider a region B such as discussed earlier. The change of the (I, /c)-entropy of B 
at time t is given by 

AS ltk (B,t) = S l>k (B,t+l) - S hk (B,t). (23) 

That is, ASi tk (B,t) is the entropy change of B with respect to the (I, fc)-partition. Then 
making use of Eqs. (0,^1]), we find 

ASi, k (B,t) = £ [-p t+1 (A)\ogp t+1 (A) + Vt(A)logp t (A) 
AeA, k nB 



E 

AeA, k nB 



-^(^(A))log^^ + ^(A)lo r ^^ 



u{A) 



(24) 



We now have an expression for the time dependent change in the coarse grained entropy of 
some set B in phase space. Suppose we keep the (I, k) -partition fixed but consider the limit 
t — » oo. If the system reaches a nonequilibrium steady state, then we can expect that the 
limit 



\imp t (A) = p(A), (25) 

will exist for all sets, A, of the partition, and that the measure will be invariant in the 
stationary state where p(A) = p(^~ 1 (A)), as implied by Eq. (|22|). But in this case, the 
entropy change defined above is zero for an invariant measure, i.e. 

AS hk (B) = 0. (26) 

Thus we have defined a coarse grained entropy which has a zero rate of change in the non- 
equilibrium steady state. We now have to decompose it into the three contributions required 
by Eq. ([□]). We first consider the time dependent case and then specialize to the case of a 
steady state with an invariant measure. 
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First, we define the rate of (I, fc)-entropy flow into the set B at time t, A e Si )k (B, t), by 
taking the difference between the (I, fc)-entropy of the pre-image of B, which we take to be 
the entropy of set B after the next time step, and the (/, fc)-entropy of B, itself. That is, 
there is no contribution to the flow of entropy into B from the set of points which are in B 
at both t and t + 1. Thus, the rate of (I, fc)-entropy flow of B is defined to be 

A e S l>k (B,t) = S l}k (^ 1 (B),t)-S l}k (B,t). (27) 

Next we can define the flow of entropy into the set B due to the presence of the ther- 
mostat, A t hSi t k(B,t). Since the thermostat is modelled by adding frictional terms to the 
equations of motion of the points and not by any boundary conditions, we have no means 
of identifying the action of the thermostat other than by the change in the volume of sets in 
the course of their time evolution. This change in volume is produced by the frictional terms 
added to the equations of motion. A reasonable definition of A th Si :k (B) should satisfy the 
requirement that this entropy flow vanishes if the transformation $ is volume preserving. 
This condition is satisfied by defining the flow of entropy into B due to the presence of the 
thermostat by 

A th Si, k (B,t) = St, k (B,t+ 1) - S l+1 , k -i($-\B),t), 

= - E M^log^™. (28) 
AeAi, k nB V \ A ) 

To obtain the second line in Eq. (0), we have used Eq. (|22|), and the fact that the pre- 
images of sets in Ai >k are sets in Ai+i )k -i. We call attention to the fact that the pre- images of 
the sets in a (/, fc)-partition are sets in a (I + 1, k — l)-partition. We have defined A th Si )k (B) 
as the difference between the entropy of the set B at time t + 1, and the entropy of the pre- 
image of B at time t, where the entropy of the pre-image sets of B are calculated using the 
pre-image of the (I, k) partition. This definition of the flow of entropy from the thermostat to 
the set B satisfies the requirement that it vanishes for a volume preserving transformation. 
The definition of AthSi tk (B,t) given above suffers from the lack of a clear derivation based 
upon a physical picture of a thermostat, as one would expect for a thermostat which acts 
only at the boundary of the system. Here the thermostat is an "internal" device which has 
the effect of modifying the equations of motion and produces a contraction of phase space 
volumes. Thus our definition of entropy flow to the system from the thermostat must be 
based on the change of the volumes of cells in phase space with time, as is done in our 
definition above. 

We now want to follow the phenomenological approach as in Eq. ([II]) and write 



AS lik {B, t) = A e S lik {B, t) + A th S l>k {B, t) + A^B, t), (29) 

where AiSi jk (B, t) represents the rate of irreversible entropy production in B. By combining 
Eqs. (^9]), with Eqs. fl2~7|) and (|28|), we obtain an expression for the irreversible entropy 
production in set B as 

A^, fc (5,t) = % 1>fe _ 1 ($- 1 (S),t) - Si^-^B^t). (30) 

Note that this equation represents the irreversible entropy production in any set B as the 
difference in the entropy of the pre-image sets at two levels of resolution. This is an important 
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result which helps us to understand that irreversible entropy production is a direct result of 
the loss of information in the coarse graining of a system. 

Therefore, we have been able to use the phenomenological approach to entropy produc- 
tion, Eq. (|TT|) and some reasonable definitions of entropy flows to obtain an expression for 
the local rate of irreversible entropy production. 

We can easily connect these definitions to that of Gaspard ]19 for the entropy production 



in a Hamiltonian system, by defining an intrinsic local rate of entropy change in the set B, 
ASi t k(B,t), by removing the term due to the thermostat as 

AS hk (B, t) = AS ltk {B, t) - A th S hk {B, t), 

= 5 m , fc _ 1 ($- 1 ( J B),t) - S l>k (B,t). (31) 

That is, we have expressed the intrinsic rate of change of the coarse grained entropy of B 
as the difference between the (I + 1, k — l)-entropy of the pre- image of B and the (I, k)- 
entropy of B itself. This expression is identical with the definition of the change in the 
coarse grained entropy given by Gaspard |19|| . Note that in a non-equilibrium steady state, 



where AS^ k {B) = 0, the rate of change of this intrinsic entropy is equal to the rate of flow 
of entropy from the system to the thermostat, —A t hSi t k{B), which as we will see below is 
positive if there is an average contaction of the phase space accessible to the system on to 
an attr actor. 



IV. (Z,£;)-ENTROPY CHANGE AND PHASE SPACE CONTRACTION 



It is important to note that in the steady state, the measure n(A) of a set A is invariant, 
i.e., = fi(A). Now, even though the measure fi(A) of a set A is invariant, the 

various terms in the rate of entropy production may not be zero because the phase space 
volumes of the elements of the partition are not equal to the volumes of their pre-image sets. 
Thus, using the fact that the pre-images of sets in Ai tk are sets in Ai+i,k-i, we find that the 
intrinsic rate of entropy change, ASi^^B), Eq. (|3"T|), becomes 



AS ltk (B) = 5 I+a , fc _i($- 1 (S)) - Si, k (B), 



- E 

AeA, k nB 



Li($-\A))ln 



u^-\A)) 



/i(A) In 



v{A) 



(32) 



Using the invariance of the measure, we have 



AS hk (B)= J2 M^) ln 

AeAi.kDB 



v{A) 



(33) 



as noted at the end of the previous section. 

We also have an expression for the volume of the pre-image sets in terms of the Jacobian, 
J($- X (r)) = |dr/d$ _1 (r)|, of the transformation 



v{<b-\A))= / dT, 

J'i>- 1 (A) 
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dT 



' "( A )> (34) 



where we the last line then follows from the mean value theorem and denotes an appro- 
priate point in A. 
Thus 

AS lik (B)= £ ,1(4) In I (35) 
In the limit where /, k — > oo the sum becomes an integral over phase space and we find 



i.k 



lim AS u(B ) = / t i(B) , m inJ Fy . (36) 



Up to a sign change, this result, or, more precisely, its generalization given below, forms the 
starting point for Ruelle's analysis of the entropy production for diffeomorphisms 0. The 
sign difference is due to Ruelle's starting with the argument that the negative change in the 
Gibbs entropy of the thermostated system is compensated by a positive entropy production. 
Here we avoid that procedure and see that it is possible to define a coarse grained entropy 
which has a positive rate of change for the system itself. 

We are now in a position to prove our main result, i.e. that the intrinsic rate of change 
of the entropy defined by Eq. fl3l|) is positive and equals the phase space contraction rate, 
for a closed, thermostated system. To do this, we identify the set B with the entire phase 
space, X, and notice that, because the system is closed, there is no flow of entropy into or 
out of the system so that A e Si^{X) vanishes. We can thus identify the rate of change of 
the, now well defined, Gibbs entropy as the irreversible entropy production in the system, 
and it is given as 



' J(T) 

£A,, (37) 



where the integral in the first line of Eq. (p7|) defines the sum over all of the Lyapunov 
exponents of the system. Ruelle has proved that this quantity is positive if the map is a 
diffeomorphism, and /i an SRB measure on X, singular with respect to the Liouville measure. 

This result shows that, for a contracting system for which the sum of the Lyapunov ex- 
ponents is negative, the stationary state intrinsic entropy change, as defined in Eq. is 
positive. It is in exact agreement with what one expects for the stationary state entropy pro- 
duction rate in these systems. Moreover, it clarifies the paradox, discussed earlier, that the 
"fine grained" Gibbs entropy yields negative stationary state entropy change rate, P,^|,p|,[16| . 

In the next sections, we will use the construction of the (I, /c)-entropy given above to 
compute the (I, fc)-entropy flow and irreversible entropy production for two specific cases 
and show how our formalism corresponds to the results previously obtained by Gaspard [TS 



for Hamiltonian-like, volume preserving maps, and those of Vollmer, Tel and Breymann (18 
for dissipative, volume contracting maps, for open systems with diffusive flows 
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V. A DETERMINISTIC BIASED RANDOM WALK 



We consider a one- dimensional random walk on a lattice where a particle hops with 
probability s (resp. 1 — s) to the right (resp. left). The diffusion coefficient for this process 



can be computed from the Green-Kubo formula, see for instance [16 



' (XT— < Xt >) 2 , 

D = lim ^ — '- = 2s{\ - s), (38) 

where xt denotes the displacement of a random walker after T time steps. We can also 
compute the mean drift velocity of this process, 

v = 1 - 2s, (39) 

measured positively towards the left direction. 

A reversible deterministic model of this process is the generalized multi-baker chain 
defined on the "phase space"0 Z x [0, l] 2 , consisting of a horizontal chain of unit squares. A 
phase point is labelled by an interger index n e Z and by internal coordinates (x, y) within 
a unit square. The dynamics of this multi-baker map is given by 



n - 1, (yzrf , s + (l- s)y)j , s < x < 1. 

See Fig. (1). This map is volume preserving. If we specifically use periodic boundary 
conditions and allow no escape of particles from the system, it is easy to show that the two 
Lyapunov exponents for this map are 

A+ = -A_ = -sins - (1 - s)ln(l - s). (41) 

Notice that for the volume preserving, closed system, the sum of the Lyapunov exponents 
is zero. 

Alternatively, we can think of the bias in the random walk as being driven by the action 
of some external field and model this driven process by a map that is not area preserving, 
|i"8| . This would then be a time-discretized model that has features similar to those of a 



system in an external field with an energy preserving thermostat. That is, as pointed out 



by Vollmer et al. [18| one hopes to capture in this model, the effects of a dynamics that 



contracts, on the average, volumes in phase space. We thus let 



(n + 1, (§, (1 - s)y)) , 0<x<s, 



[n-1, (jrr-f , 1 - s + s y)) , s < x < 1. 

See Fig. (2). The phase space volumes are not locally preserved and the periodic version of 
this map has two Lyapunov exponents 



3 In practice, and for the sake of definiteness of the measure, we will restrict the map to a finite 
region C € Z and will specify some boundary conditions 
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A + = — s Ins — (1 — s) ln(l — s), 

A_ = sln(l-s) + (l-s)lns. (43) 
The negative of the sum of the Lyapunov exponents, 

- (A+ + A_) = (2s-l)ln— ^- > 0, (44) 

1 — 6' 

is the phase space contraction rate. In the following discussions, we consider both of these 
maps and will make explicit distinctions when appropriate. When we wish to refer to the 
two maps without distinguishing between them, we will use the notation $( c ) for the maps. 

For either case, we denote by //„ the cumulative, or total, measure of the n-th unit square. 
Using the Perron- Frobenius equation or other methods, [ I9|jZ0 , one can easily see that for 
either version of the map, $( c ), the stationary measure of the chain satisfies the equation 

/!„ = s/i n _i + (1 - s)n n+ i. (45) 

The solution of this equation is easily found to be 

Hn = Aa n + B, (46) 

where a = s/(l — s) and A and B are fixed by the boundary conditions. 



VI. (Z ; A;)-ENTROPY AND ENTROPY PRODUCTION RATE FOR 

MULTIBAKERS 



We now follow the procedure outlined in Section II, and construct the (/, fc)-partitions, 
and entropies of the maps $( c ). 

The (I, /c)-partition is a collection of 2 l+k non intersecting rectangles that cover each of 
the unit squares in the chain, with an identical covering for each square. Then for each 
square, the number of elements along a line in the expanding direction is 2 l , and 2 fc is the 
number of those along the contracting direction. To make this more precise, we introduce 
a symbolic dynamics on the squares. Let us consider one particular square and notice that 
any (/, fc)-partition of that square is generated by images or pre-images of the two sets 

T(0) = {{x,y)\0<y<s}, 
r(l) = {(x,y)\s<y<l}, 



for the case of $, 



and 



r c (0) = {(x,y)\0<y<l-s}, 
r c (l) = {(x,y)\l-s<y<l}, 



for the case of $ c , fl4|)[|. 



4 Following the notations introduced earlier, we have 

A = {F( c )(n,LJ n ), n£ C, u n £ {0, 1}}, 
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An (l,k)-set, r(u;_j, . . . , uJk-x) with u>j G {0,1}, j 
(x, y) such that (regardless of the lattice coordinate) 



Notice also that 



k 



1, is the set of points 



$ j (x,y) e r(^), j = -/,..., k- 1. 



$ ^(w-j, . . . , Wfe_i) = r(wL { _ 1 , . . . , ^_ 2 ), 



(47) 



with a;'- = wy+i,. This expresses the conjugation between $ and the shift operator on 
symbolic sequences. We define r c (a;_;, . . . , cu/c-i) in a similar way and with the same property. 
As examples, Figs. (3) and (4) show the (1, 1) and (0, 2)-sets of $ and $ c , respectively. 

We will use the notation fi n (u-i, . . . , uJk-i) to designate the measure of the corresponding 
(I, fc)-set of cell n irrespective of which map is being considered. We will further denote the 
volume of the corresponding sets by u{T(u-i, . . . ,Uk-i)) and u(T c (lu-i, . . . ,Uk-i)) and will 
use the notation u(u_i, . . . , Uk-i) when we want to avoid referring to a specific choice of 
map. We have 



where 



u(T(uj-i, . 



,Wfc_i)) 



(48) 



V\iQ 



J ■ 



CO j 



1 — S, Ldi 



(49) 



and 



S, UJj 



0. 
1. 



(50) 



We now proceed to evaluate the (/, fc)-entropy of a site n given by 



Si,k{n) = - 



E 



hi 



- 1 



(51) 



Notice that this is just the coarse grained version of the Gibbs entropy, defined by Eq. (|1J 
where the set B is now the unit square representing the site n. From now on, we will drop 
the constant term in the expression (|5T|) of the (I, fc)-entropy. As discussed in the Appendix 
A, the stationary state measure is uniform along the x, or expanding, direction. From this 
it follows that the entropy is extensive with respect to the x-direction. Thus, 



where we indexed the elements of the partition by the square n they belong to. Ai k can be 
generated by taking images and pre-images of this partition. However, in order for us not to worry 
at this point about technicalities involving the boundary conditions, we will find it more convenient 
to define the (I, fc)-partition by iterations of local maps, i.e. dropping the index n for that purpose. 
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Si,k(n) = S 0)k (n), 



(52) 



and we are allowed to drop the I dependence. When appropriate, we will simply refer to the 
fc-entropy of n and write S k (n). 

To derive the (I, fc)-entropy production rate, use Gaspard's method |L9j and write the 
rate of intrisic entropy change as the sum of an entropy flow and an irreversible entropy 
production, as in Eq. (|3~1~D. 

To compute the rate of change in entropy, we notice from Eq. (4~7) that the pre- image 
of an (/, k)-set is an (I + 1, k — l)-set. Thus as in the more general case discussed earlier, 



ASi tk (n) = S'/ + i ifc _i($ (c J(n)) - Si >k (n), 
Let us take / = 0. The first term on the RHS is then 



(53) 



E 



/i n _i(0,cu , . . . , Uk-2) In 



u(0,u ,.. .,u k _ 2 ) 



4-1, (l/i f.i \ In / X "+l(l?^'0; 
+Mn+lV i ) a; 0) • • • i^k-2) m 



. ^k-2) 



(54) 



But, from Eq. (f48|) , we know that the measures and volumes appearing in the above equation 
are given by 

/i n _l(0, Uq, . . . , UJk-2) — Sfi n -l(uJo, . . . , UJk-V-i 
/^n+l(l, • • • j Uk-2) = (1 — s)fl n+ i(lJo, . . . , tOk-2), 

u(0, uj ,..., w fc _ 2 ) = su(u , . . . , Wfe_ 2 ), 

1/(1, uj ,..., cu fc _ 2 ) = (1 - s)u(u , w fe _ 2 ). (55) 



We can thus rewrite Eq. ([54]) as 



o;o,.-- I ^'fc-2 



s/x„_i(o;o, • • • , u; fc _ 2 ) In 



Mn-i^O; • • • j ^fc-2) 



+ (1 - s)fi n+ x(u> , . . .,u k -2) In 
sS 0)k -i(n - 1) + (1 



1/(^0, • • • ,^fc-2) 

{UJQ, . . . ,Wfc_ 2 ) 

z/(w , . . . ,u; fc _ 2 ) 

s)<S(),fc-l(n + 1). 



(56) 



By making use of Eq. ([5*2"D, we conclude that the rate of entropy change at site n satisfies 
the simple difference equation 



AS k (n) = sS k -i(n - 1) + (1 - s)S k -i(n + 1) - S k (n). 



(57) 



We now consider the contributions to this entropy change from the entropy flow and the 
irreversible entropy production. The entropy flow rate is given by 

A e S ljk (n) = S^i^in)) - S^n). 

By the same argument as above, 

Si,fc(^ c )(n)) = sS 0>k (n - 1) + (1 - s)S Q>k (n + 1). (58) 
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So that, using Eq. ( |5^ ) again, we have 

A e S k (n) = sS k (n - 1) + (1 - s)S k (n + 1) - S k (n). (59) 



With Eqs. (|57|) , and (|59|) , we can derive an expression for the irreversible entropy 
production rate 

AiS k {n) = AS k (n) - A e S k (n), 

= s[S k ^(n - 1) - S k (n - 1)] + (1 - s)[S k ^(n + 1) - S k (n + 1)], 

= Sfc(n) - S'k+iCn), (60) 



where the last line is a consequence of Eq. (^). Using Eq. flST]), we can obtain useful 
expressions for the irreversible entropy production as 

AiS k (n) = V fi n {uJo, ...,u) k )ln : : : ? (61) 

for the case of the volume preserving map, $, and 

A;S fc (ri) = Vniua, ■ ■ ■ , w k ) In v /^n(^o, ■ ■ ■ , o; fc ) 2 

for the case of the contracting map, $ c . 

Notice that Eq. (|60D contains the important result that 



AiS k (n) = sAiS k ^(n - 1) + (1 - s)A 4 5 fc _ 1 (n + 1). (63) 

This relation enables us to compute the fc-entropy production rate recursively from a knowl- 
edge of the 0-entropy production rate. 



VII. ENTROPY PRODUCTION RATE FOR FLUX BOUNDARY CONDITIONS 

In this section, we specify our study to the case of flux boundary conditions. That is, 
we consider a chain of L sites and impose the boundary conditions : 

Mo = 1, 

fJLL+X = L + 2. 

This way, there is an average gradient of density of 1 per unit cell across the system. With 
these boundary conditions, the constants A and B in Eq. ( fj6|) are found to be 

A - L + 1 

a L+1 -V (64) 

B = 1 - A. 

Fig. (5) shows n n for L = 100 and parameter values s = 0.45, 0.5, 0.55. Notice that, with 
the exception of s = 0.5 which corresponds to a linear growth, the exponential growth is 
so steep that the density is almost constant on the larger part of the lattice. In the limit 
when L — ► oo, fi n becomes a constant and is either L + 2 or 1 depending on whether s < 0.5 
or s > 0.5 respectively. As we will see shortly, it is precisely the exponential profile of the 
density that is responsible for the divergence of the fc-entropy production rate, see Eqs. (|68| , 
91). 
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A. Volume preserving case 



Let us now apply the formulae ( pl| p3j ) to the system with the specific boundary condi- 
tions given by Eqs. (pE6|), and fl64|). We first compute the 0-entropy production rate. 



AiS (n) = ^2fi n (uj )ln 



v{uo)jJL n ' 



s^ n _iln 



/in 



[1 - s)fi n+1 In 



/^n+l 



s(Aa n " 1 + B)ln 
s(ia"- 1 + B) In 



Aa 



n-1 



B 



Aa n + B 
Aa 

1 + 



s)(Aa n+1 + B)ln 



Aa n+L + B 
Aa n + B ' 



1) 



+ (l-s)(Aa n+1 + B)\n 



1 + 



Aa n + B 



[a -I) 



(65) 



Fig. (6) shows a numerical computation of this quantity. The dependence on n is 
exponential with slope 2 In a with the exception of s = 0.5 for which the entropy production 
goes like 1/n, which is the case considered by Gaspard JTS . 



If we now assume L >> n » 1, the second terms in the logarithms are very small 
so that we can expand the logarithms around 1 and keep the leading terms (up to second 
order). After carefully examining the relative sizes of the various terms, we find that the 
irreversible entropy production is given by 



2„2n 



(l-2s) 2 A 2 a 
2s(l-s) Aa n + B' 



(66) 



Now, if we define the discrete gradient of fi n with respect to n as a symmetrized finite 
difference, i.e. 

n[(/in+l - ^n) + (/in - l^n-l)}, 

2s - 1 



V/x r 



Aa n 



then the 0-entropy rate production 

A i 5'o(n 



2s(l - s y 
I becomes 



D 



(V/in) 
/in 



(67) 



where D is the diffusion coefficient (|38|). 

With our recurrence relation (|63|), we can now carry out the computation of the k- 
entropy production rate for any k. In Figs. (7) and (8), we show the first ten fc's for the 
same lattice of length L = 100 and s = 0.45 and s = 0.55 respectively. Notice that these 
curves display some k dependence. In Figs. (9) and (10), we show the k dependence of the 
entropy production for the middle site, n = 50, of a 100 site chain, for both small and large 
k. The fc-entropy appears to increase exponentially for the lower part of the k range, Fig. 
(10), and then starts to decay exponentially, Fig (10). 

The exponential growth can be understood directly form Eqs. ( |63| . |66| ) . Indeed, let us 



assume 
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Using Eq. we find 



. „ . . (1 - 2s) 2 A 2 a 2 " nk 



In appendix A, we rederive this k dependence from the knowledge of the stationary state 
and Eq. fl62|) , see Eq. (|A23|) . Notice that this ignores the finite size effects. Of course, 



this exponential divergence is of unphysical nature and one would expect that the entropy 



production be independent of k. In their model with a third middle band, Vollmer et al. JT 
introduced a special scaling that allowed them to get rid of this divergence, while keeping 
the zeroth order term in Eq. (|68|). 

The finite size effects are those responsible for the exponential decay at large values of 
k. To understand these finite size effects, notice that the value of k gives the number of 
time steps for which we know where the points located in a specific set will go. The only 
possibility for these sets to produce entropy is if they remain in the chain for more than k 
steps. Indeed, among all the sets, those that exit the chain within k steps will propagate 
freely forever either to the left or to the right so that no further information is gained by 
increasing the resolution of these sets. Now, as we increase k there are more and more such 
sets that do not contribute to the entropy production rate. This exponential decay continues 
for arbitrarily large k because, in the steady state, there are arbitrarily fine variations in the 
density of points on the chain, as can be seen from the singular nature of the SRB measure. 

The relation of this exponential decay to the escape rate is easy to derive. Indeed if, 
for an open system, the probability density decays like 7 (the escape rate), then one easily 
finds that the entropy should decay like 7. This can be verified numerically. For the case of 



a system with mean drift velocity v, given in our case by Eq. (^3), Tel et al. |L8[ showed 
that the escape rate formula of Gaspard and Nicolis should be generalized to 

Fig. (11) shows a comparison between that formula and the numerically computed decay 
rate of the entropy production. The agreement is best around s = 1/2. We believe that 
the small discrepancies for other values of s, which are quadratic in s, may be due to small 
numerical errors and/or to next order corrections in 1/L. 



B. Dissipative case 

We now switch to $ c and use formula (^) to compute the 0-entropy production rate. 



AiS (n) = Y^/J>n(u ) In 



, s// n _i (1 — s)fi n+1 
s^ n _ a In h (1 - s)fi n+1 In 

(1 - S)H n SfMn 
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= s// n _a In h (1 - s)/i n+ i In 

- (1 - s)// n+1 )ln j— , (71) 
= A^(n)+A^<V), 

where 

AiSQ P \n) = s/i n _i In + (1 - s)fi n+1 In 
is the contribution from the volume preserving part, identical to Eq. (|65|) , and 

AiS^in) = (s/i n _i - (1 - sK +1 ) In ^- = (2s - - Aa n ) In ^- (72) 

reflects the presence of phase space contraction. Fig. (12) shows a numerical computation 
of this last term. It is constant and positive everywhere except in the vicinity of the bound- 
aries, where it may become negative. It is remarkable, though, that the total 0-entropy 
production rate, Eq. ([n]), is positive everywhere, as shown in Fig. (13). Also, notice that 
the contribution due to the dissipative term is generally much larger than the first term 
which is the only contribution in the volume preserving case. 
Note that the dissipative term, 

(fx n -2Aa n )(2s- l)ln 



is nothing but the phase space contraction rate ( fH| ) multiplied by fi n — 2Aa n . We have thus 
shown that 

A iSo ( n ) = D^£- - (ji n - 2Aa n )(\+ + A_). (73) 

In the infinite volume limit B takes on the values 1 or L + 2, depending upon a, and one can 
check that the entropy production rate becomes independent of the boundary conditions. 
Indeed, the squared gradient term is overwhelmed by the second term, which is equal to the 
phase space contraction rate one gets for periodic boundary conditions, and the third term, 
involving Aa n , is negligible in this limit. 

We also note that the thermostated system approach has been applied by Chernov et 
al. to systems in which no density gradient is present. They consider the diffusion of a 
charged, moving particle in a fixed array of hard scatterers, the periodic Lorentz gas, and 
use an [electric field + thermostat] to generate an isokinetic electric current in the system. 
In this case, there is no density gradient and all of the irreversible entropy production 
comes from the phase space contraction. The entropy production is then determined only 
by the Lyapunov exponents and for small electric fields, at least, the entropy production 
is proportional to the square of the electric field with a coefficient that agrees with the 
predictions of irreversible thermodynamics. 

Returning to our model, we can make use of the recursion relation, Eq. (|63D , to compute 
the entropy production for different values of k. Although the k dependence will remain in 
the volume preserving part, we find that the dissipative term does not depend on k so that 
in this case the largest contribution to the entropy production rate does not depend on the 
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resolution parameter. We remark that this property is specific to piecewise linear maps and 
should not be expected to be a general feature. Indeed, whereas, for a piecewise linear map, 
Eq.(p5]) has a constant Jacobian in every single region of the partition, it will not be so for 
non piecewise linear maps. As suggested by Eq. (^), we will in general need to take the 
limit of infinite resolution to retrieve the phase space contraction rate. 



VIII. DISCUSSION 



We have shown that Gaspard's method [19fl of defining a coarse grained Gibbs entropy 



and its rate of change for an Anosov-like, volume preserving dynamical system can be gen- 
eralized and extended to include non-volume preserving Anosov-like systems which develop 
a nonequilibrium stationary state SRB measure on an attractor. The rate of entropy pro- 
duction in such a system is positive, and the total rate of entropy production in a closed 
system is given by the negative of the sum of the Lyapunov exponents of the map. Very 
close results have previously been obtained by Vollmer, Tel and Breymann, [18|]. Our con- 



tribution is mainly to show that Gaspard's coarse graining method is a natural one to use 
in this context, and that it reveals quite clearly the relation between the rate of irreversible 
entropy production and the loss of information about the system's trajectory due to the 
coarse graining. This method allows one to take a limit where the coarse graining size is 
taken to zero after the non-equilibrium steady state is reached, and in this limit we recover 
the formula used by Ruelle || to prove that the rate of entropy production is positive in the 
type of systems treated here. 

The biased random walk models discussed here have a number of interesting features. 
They are relatively simple to analyze, and they exhibit an exponential growth and subsequent 
decay of the entropy production as the size of the coarse graining regions becomes smaller. 
However, for all values of s, except s = 1/2, the density profile in the non-equilibrium steady 
state is very unphysical, and the large-system limit yields a trivial result where the density 
profile is uniform except very close to the boundaries. The exponential divergence of the 
rate of entropy production as the coarse graining size gets large, at least over a range of k, 
is a striking difference between the multi-baker chains we consider in this paper and that 
studied by Gaspard Indeed, whereas Gaspard showed, for s = 1/2, that 



lim lim lim ^ n 2 AiSk = D, (74) 

fc^oo (V/i„)//i„->0i-+oo (V/i n ) 



we find, for s ^ 1/2, that 



lim lim lim -f^A^f p > = D K / ' ' . (75) 

We believe that this point should be seen as a defect of the models we treat and will be 
addressed with more realistic models in further papers. 

Tel, Vollmer and Breymann [|5, 18,23] consider a multi-baker model where the squares 



are organized in subsets that move to the right, left or stay within the squares. They show 
that there is a good scaling limit for which the density profile is governed by a well defined 
Fokker Planck equation and is linear. 
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We have chosen an alternative approach to the problem of finding a realistic but an- 

we 



alytically tractable model of a system with a thermostat. In a subsequent paper |26 
will discuss a model which can be described as a random walk driven by a thermostated 
external electric field and which takes the form of a nonlinear baker map. Such models 
mimic thermostated Lorentz gases which have been the subject of a number of theoretical 
and computational studies [§,|I^,|14],^7]] . There we will also find an interesting transition of 



the dynamics from hyperbolic to non-hyperbolic behavior as a function of the strength of 
the external field, with dramatic consequences for the diffusive properties of the system. 

It has been realized for many years that the resolution of the "Gibbs paradox" in entropy 
production, for many-particle systems, depends upon using reduced distribution functions 



which themselves give a very coarse grained description of a many particle system |]16| , |21| , |22 



Then the macroscopic entropy production can be clearly identified, as in Boltzmann's H- 
theorem, with the loss of information about the system's fine grained phase space distribution 
with time. We have discussed here a closely related and no less important mechanism 
for information loss and entropy production, namely the formation of fractal phase space 
structures in non-equilibrium stationary states as the support for singular measures. The 
two mechanisms are related by the fact that even for Hamiltionian systems, the support 
of the fine grained, Gibbs distribution can evolve to a fractal that looks smooth in phase 
space in some directions but highly singular in others. These fractal structures require the 
application of coarse graining methods to correctly describe irreversible processes in fluid 
systems and for an understanding of why the reduced distribution functions approach their 
equilibrium values in the course of time. 

ACKNOWLEDGEMENTS: This paper is dedicated to E. G. D. Cohen in celebration 
of his 75-th birthday - ad mea v'esrim. The authors wish to thank P. Gaspard, T. Tel, J. 
Vollmer, W. Breymann, C. Dettmann, A. Latz and E. G. D. Cohen for a critical reading 
of a draft of this paper which the authors feel has greatly improved its clarity. They also 
thank S. Tasaki, H. van Beijeren, R. Klages, and C. Ferguson for helpful discussions, as well 
as the referees for their helpful remarks. J. R. D. wishes to acknowledge support from the 
National Science Foundation under grant PHY -96 -00428. 



APPENDIX A: PROPERTIES OF THE SRB MEASURES 

In this appendix we briefly summarize the properties of the SRB measures for the multi- 
baker chains discussed in this paper and derive an analytical expression for the /c-entropy, 
Eq. (|62|). For more details we refer to the papers of Gaspard f[9 |, of Tasaki and Gaspard 



and of Tasaki, Gilbert, and Dorfman P5] |. We consider here the case of the volume 
contracting multibaker map, $ c , with flux boundary conditions. 

The SRB measure for this system is obtained by using the Frobenius-Perron equation to 
derive an expression for the cumulative measure in each unit square. The Frobenius-Perron 
equation for the (singular) invariant density associated with this map is 

p(T)= jdV'5{Y-^ c {V'))p{V), (Al) 

or 
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p(n, x, y) = { n ~ sx ' T=~s) > < y < 1 - s, 

= ( n + 1, g + (1 - s)x, y - l + s V l-s<y<l. (A2) 



The cumulative measure, G(n, x, y) in each square is defined by 

rx ry 

G(n,x,y) = / dx' I dy'p(n,x ,y'). (A3) 



The measure of any region in a unit square can then be defined as the difference of two 
cumulative functions. For example, the region defined by a particular sequence {u , ^fc-i} 
in square n is a horizontal strip extending over the full x interval, and contained between 
y(u , uj k -i) and y(u , uj k -i + 1), so that 

/i„Oo, u k -i) = G(n, 1, y(uj , uj k -i + 1)) - G{n, 1, y(u , u k -i)), (A4) 

where we have introduced the notation 



+ 1 = Uj-i, 1, ujj = 0, 
= ujj-i + 1, 0, Uj = 1, 



(A5) 



with the convention that y(l, . . . , 1, 1 + 1) = 1. 
We can also write explicitely 

fc-i 

y(u , ...,u k -i) = u) Q (l - s) + ^3(1 - s)u*(u , Uj-i), (A6) 

i=i 

where v* is as defined by Eq. (|50"D. In particular, we note that 

?/(0, cji, w fe _i) = (1 - s)2/(^i, Wfc-i), (A7) 
?/(l, cji, w fe _i) = 1 - s(l - y(wi, Wfc-i)). (A8) 

These equations will be used in the sequel. 

It follows from the Frobenius-Perron equation (|A2|) that G(n,x, y) satisfies the equation 



G(n, x,y) = G{n- 1, sx, , < y < 1 - s, 

= G(n - 1, sx, 1) + G (n + 1, (1 - s)z + s, ^~ ^ + g 



-G(n + l,s,2 — i^), 1-s<2/<1. 



(A9) 



Then, the total measure of the n-th square, /i n , satisfies the equation 

p n = G{n, 1, 1) = G(n - 1, s, 1) + G(n + 1, 1, 1) - G(n + 1, s, 1). (A10) 



It is now possible to see that there is a solution of Eq. ( |A9f) for G(n, x, 2/) which has the 
form 

G(n, x, y) = x[y(p n - B) + BT n (y)], (All) 
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where //„ is a solution of Eq. ( |45|) , 5 is given by Eq. fl64|), and T n (y) satisfies the recursion 
relation 

T n {y) = sT n _ a (y^-) , < y < 1 - s, 

l-v\ , (A12) 



= s + (1 - s)T n+1 M - , 1 - s < ?/ < f . 

The boundary conditions on the functions T n (y) are T (y) = T L+ x(y) = y. These functions 
will be referred to as incomplete, see Tasaki and Gaspard p0 |, as opposed to the function 



T(y) which appears in the case of periodic boundary conditions, see Tasaki et al. |25], 

T(y) = sT (j^) , < y < 1 - s, 

= s + (l- s )rfl-i^V l-s<y<l. (A1 ' )) 



The solution given by Eq. ( All ) leads immediately to the recursion relation, Eq. (|45|), for 



the measures //„. Furthermore, this expression for G(n,x,y) has the form expected for the 
cumulative distribution of an SRB measure : it is smooth (actually uniform) in the expanding 
direction, and singular in the contracting direction. The singularity in the contracting, or 
y-direction, can be seen when the recursion relations are solved for the functions T n (y). 
In the limit where the boundaries are infinitely far away, T n (y) is replaced by the limiting 
function T(y), which is a continuous function that has zero derivatives almost everywhere. 
It is the singularity of T(y) which prevents the measure from having a well behaved density, 
and requires the use of the coarse graining procedure described in the body of this paper. 
Fig. (14) shows, for s = .55, the limiting function T(y) — y, singular on every length scale. 
Figs. (15-20) show, for the same value of the parameter s, the incomplete functions T n (y)—y 
truncated due to the boundary conditions T (y) = Ti + i(y) = y. For some fixed length scale, 
these functions quickly become singular (their derivatives have discontinuities inside the 
corresponding y interval) as we move away from the boundaries. Entropy production is 
positive in the y intervals where T n (y) has singularities. 

Before we proceed to the derivation of the fc-entropy, we make use of Eqs. ( |A7| , |A~8|) to 
derive a useful expression of the T n (y). Note that 

T n [y(0,ui, ...,Lu k _i)) = T n ((l - s)y(u l , w fc _i)) , 

= sT n _i^(wi, ...,cjfc_i)J, 
T n (y(l,ut, ...,Uk-ifj = T n (l - s(l - y(ut, c^-i))) , 

= s + (1 - s)T n+l (y(uJi, ...,a; fc _i)J. 

As long as we are far enough from the boundaries, we can replace the T n (y) by their limiting 
values T(y) (this amounts to assuming 1 << n « L). In this case, it follows that 

fc-i 

T(y(u , u; fc _i)) = su + J2 sujju(uj , ujj-i), (A14) 

3=1 

where v is as defined by Eq. d49|) . 
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With the help of Eq. flA4j) , we can make use of Eq. ( |A11| ) to rewrite the entropy 
production rate formula, Eq. (|62|). Ignoring the boundary effects, Eq. ( [A4] ) gives 



/i n (uj , u k -i, 0) = B [T(y(u , 1)) - T(y(uj , . .., u k -i))} 

+Aa n (l- s)is*(uJo,...,u>k-i), 
li n (u Q , Wfc_i, 1) = 5 [T(y(u; , . . . , io k _ x + 1)) - T(y(u , cj fc _i, 1))] 



Writing 



AT a = T(y(w , • • • , Wfc_i, 1)) - T(y(u , Wk-i)), 
AT, = T(y(u , . . . , u; fe _i + 1)) - T(y(uj , . . . , 1)), 

e = v4a n i/*(a;o, . . . ,a; fe _i), 



(A15) 
(A16) 



the /c-entropy production rate becomes 



AiS k (n) 



E 



OJ0,---!^fc-l 



(BAT a + (1 - s)e) In 
+ (5AT 6 + se) In 



£?AT a /(l- S )+e 
5AT a + BAT b + e 

BAT b /s + e 



BAT a + BAT b + e 



(A17) 



In the limit 1 << n << L, Aa n « 1 so that we can expand the logarithms. Up to second 
order, we find 



AiS k {n) 



E 



(BAT a + (1 - *) In + (BAT b + «) In BAT ' /S 



+ 7^ 



AT a + AT 6 
1 



25 V AT„ AT h AT,, + AT, 



AT a + AT 

(A18) 



The following properties of AT a and AT, follow easily from Eqs. ( |A14| , |A15| ) : 



AT a = s(AT a + AT 6 ), 
AT b = (l-s)(AT Q + AT). 



Eq. (|A18|) thus becomes 



where we have set 



A^W(n) 



A i S k {n) = A l S i k vp \n) + A i Sr{n), 



(<*), 



(A19) 



E 



1 - s) 2 s 2 



2B(AT a + AT b ) 

(1 - 2s) 2 AV" 
2s(l-s) 5 



+ 



E 



\ s 1 — s 

z/(a;o, . . . ,u k -i) 2 
AT a + AT ' 



(A20) 
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and 



A i sl d) (n) = (2s-l)\n- 



[B(AT a + AT b )-e] 



UQ,...,Uk-l 



= (2s- l)ln— -(B- Aa n ). 

To derive Eq. ( |A21| ) we made use of the property 

AT a + AT b = 1, 



(A21) 



LL>Q,...,UJ k _ 1 



which follows from the identity 

AT a + AT b = u(u , u k -i), 



(A22) 



that follows itself easily from Eqs. ( A14 , A15|) . 

The comparison between Eqs. ( A1S - A21|) and the corresponding 0-entropy production 
rate, Eqs. (|67| , [7l| , |72|) is straightforward. Set k = in Eq. ( |A20|) . Then there is no index 
over which to sum, v* is replaced by 1, and 

AT a + AT b = T(l) — T(0) = 1. 

As of Eq. ( |A2 1| ) , it is just the same as Eq. (|72|), thus confirming the k independence of that 
part of the fc-entropy production rate. 

Let us now investigate the k dependence of Eq. ( |A20[ ). To this effect, we rewrite Eq. 
( [&20D using Eq. (TAJD : 



2s? A 2 a 2n 



n 



2s(l 



B 



E 



2„2n 



[1 - 2sYA 2 a 



2s(l-s) B V? v(v) 
'l-2s) 2 A 2 a 2n ({I ^ 



2\ k 



a; 



2s(l-s) 5 



sl-s 



(A23) 



We thus conclude that the volume preserving part of the /c-entropy diverges exponentially 
with k ! This is quite remarkable as it differs dramatically from the expression Gaspard | 1^ 



gave for the case s = .5 for which the k divergence is linear and is next order in the small 
parameter and thus vanishes in the limit ([T4j). In our case, the divergence is of the same 
order in Aa n , which illustrates the breakdown of the /c-entropy production for biased random 
walk models considered here. 



27 



REFERENCES 



[1] W. G. Hoover, Molecular Dynamics (Springer- Verlag, Heidelberg, 1986). 
[2] D. J. Evans, G. P. Morriss, Statistical Mechanics of Non-Equilibrium Fluids (Academic 
Press, London, 1990). 

[3] N. I. Chernov and G. L. Eyink and J. L. Lebowitz and Ya. G. Sinai, Steady State Electric 

Conductivity in the Periodic Lorentz Gas, Com. Math. Phys. 154, 569 (1993). 
[4] D. Ruelle, Positivity of Entropy Production in Nonequilibrium Statistical Mechanics, J. 

Stat. Phys. 85, 1 (1996). 
[5] W. Breymann, T. Tel and J. Vollmer, Entropy Production for Open Dynamical Systems, 

Phys. Rev. Lett. 77, 2945 (1996). 
[6] C. P. Dettmann and G. P. Morriss, Hamiltonian Formulation of the Gaussian Isokinetic 

Thermostat, Phys. Rev E 54, 2495 (1996). 
[7] B. L. Holian, W. G. Hoover, H. A. Posch, Resolution of Loschmidt's Paradox : The 

Origin of Irreversible Behavior in Reversible Atomistic Dynamics, Phys. Rev. Lett. 59, 

10 (1987). 

[8] W. G. Hoover, Reversible Mechanics and Time's Arrow, Phys. Rev. A 37, 252 (1988). 
[9] H. A. Posch, W. G. Hoover, Lyapunov Instability of Dense Lennard- Jones Fluids, Phys. 
Rev. A 38, 473 (1988). 

[10] D. J. Evans, E. G. D. Cohen, G. P. Morriss, Viscosity of a simple Fluid from its Maximal 
Lyapunov Exponents, Phys. Rev. A 42, 5990 (1990). 

[11] D. J. Evans, E. G. D. Cohen, G. P. Morriss, Probability of Second Law Violations in 
Shearing Steady States, Phys. Rev. Lett. 71, 2401 (1993). 

[12] A. Baranyai, D. J. Evans, E. G. D. Cohen, Field Dependent Conductivity and Diffusion 
in a Two- Dimensional Lorentz Gas, J. Stat. Phys. 70, 1085 (1993). 

[13] G. Gallavotti and E. G. D. Cohen, Dynamical Ensembles in Nonequilibrium Statistical 
Mechanics, J. Stat. Phys. 84, 899 (1995) ; G. Gallavotti and E. G. D. Cohen, Dynamical 
Ensembles in Stationary States, Phys. Rev Lett. 74, 2694 (1995). 

[14] L. Rondoni, G. P. Morriss, Stationary Nonequilibrium Ensembles for Thermostated Sys- 
tems, Phys. Rev. E 53, 2143 (1996). 

[15] J. R. Dorfman and H. van Beijeren, Dynamical Systems Theory and Transport Coeffi- 
cients: A Survey with Applications to Lorentz Gases, Physica A 240, 12 (1997). 

[16] J. R. Dorfman, An Introduction to Chaos in Non- Equilibrium Statistical Mechanics 
(lecture notes, 1998). 

[17] S. R. de Groot and P. Mazur, Non-Equilibrium Thermodynamics (North-Holland, Am- 
sterdam, 1962), reprinted in (Dover Publications, New York, 1984) 

[18] T. Tel, J. Vollmer and W. Breymann, Transient Chaos : the Origin of Transport in 
Driven Systems, Europhys. Lett. 35, 659 (1996) ; J. Vollmer, T. Tel and W. Breymann, 
Equivalence of Irreversible Entropy Production in Driven Systems : an Elementary 
Chaotic Map Approach, Phys. Rev. Lett. 79, 2759 (1997). 

[19] P. Gaspard, Entropy Production in Open, Volume Preserving Systems, J. Stat. Phys. 
89, 1215 (1997). P. Gaspard, Chaos, Scattering, and Statistical Mechanics (Cambridge 
University Press, Cambridge, 1998). 

[20] S. Tasaki and P. Gaspard, Fick's Law and Fractality of Nonequilibrium Stationary States 
in a Reversible Multibaker Map, J. Stat. Phys. 81, 935 (1995). 



28 



[21] R. C. Tolman, The Principles of Statistical Mechanics (Oxford, London, 1938), reprinted 
in (Dover Publications, New York, 1979). 

[22] P. and T. Ehrenfest, The Conceptual Foundations of the Statistical Approach in Me- 
chanics (Cornell University Press, Ithaca, 1959). 

[23] J. Vollmer, T. Tel, and W. Breymann, Entropy Balance in the presence of drift and 
diffusive currents: an elementary map approach, Phys. Rev. E, (to appear) ; J. Vollmer, 
T. Tel and W. Breymann, Entropy Balance, Time Reversibility, and Mass Transport in 
Dynamical Systems, submitted to Chaos (1998). 

[24] Ya. G. Sinai, Topics in Ergodic Theory, Princeton Mathematical Series, 44 (Princeton 
University Press, 1994, Princeton N. J.). 

[25] S. Tasaki, T. Gilbert and J. R. Dorfman, An Analytic Construction of the SRB Measures 
for Baker-type Maps, Chaos 8, 424 (1998). 

[26] T. Gilbert, C. Ferguson, and J. R. Dorfman, Field Driven Thermostated System : A 
Non- Linear Multi-Baker Map, Phys. Rev E 59, 364 (1999). 

[27] G. P. Morriss, C. P. Dettmann, and L. Rondoni, Recent Results for the Thermostated 
Lorentz Gas Physica A, 240, 84, (1997). 



29 



FIGURE CAPTIONS 

Figure 1. The volume preserving, deterministic version of the biased random walk, $, 
defined by Eq. (gDJ). 

Figure 2. The dissipative, deterministic version of the biased random walk, $ c , defined 
by Eq. (|g). 

Figure 3. The (1, 1) and (0, 2)-sets of $. The dots indicate the separation between the 
indices I and k. 

Figure 4- The (1, 1) and (0, 2)-sets of $ c . The dots indicate the separation between the 
indices I and k. 

Figure 5. The stationary state distribution fi n , solution of Eqs. (fP], p^) , on a chain of 
L = 100 sites as a function of the lattice coordinate n (s = .5 is the solid line, s = .45 the 
dadhed line and s = .55 the long dashed line). 

Figure 6. 0-entropy production, AjSo(n), in the volume preserving case, Eq. (|65"D for a 
chain of L = 100 sites as a function of the lattice coordinate n and for s = .1, . . . , .9 from 
left to right (the solid line corresponds to s = .5). 

Figure 7. k-entropy production, AjS^n), in the volume preserving case, for k — 0, . . . , 9, 
numerically computed using Eq. (j63|) , s = 0.45 and L = 100. 

Figure 8. k-entropy production, AjSfc(n), in the volume preserving case, for k — 0, ... ,9, 
numerically computed using Eq. fl63|), s = 0.55 and L = 100. 

Figure 9. k-entropy production, AjS^n = 50), in the volume preserving case, as a 
function of k, numerically computed using Eq. (0), L = 100. Both s = 0.45 and s = 0.55 
are displayed. On the long range scale, the entropy production decays exponentially as a 
function of k as the invariant measure gets mostly smooth on the corresponding scales. 

Figure 10. Blow up of Fig. (10) for k = 0, ... , 50. The fc-entropy diverges exponentially 
with k. The slope is given by Eq. ( |A23[ ) . 

Figure 11. A comparison between the escape rate given by Eq. ( ffOl) (solid line) and the 
numerically computed decay rate (diamonds) of the entropy production at large values of k 
as a function of s (L = 100 and the decay rate was measured at k = 8000). 

Figure 12. Dissipative part, /S.iS < ^'\n) 1 of the 0-entropy production, Eq. (|72|), for a chain 
of L = 100 sites as a function of the lattice coordinate n. s = .l,---,.9. The s-values 
increase from top to bottom. 

Figure 13. Total 0-entropy production, Eq. (|71~1) , in the dissipative case for a chain of 
L = 100 sites as a function of the lattice coordinate n. s = .1, ■ • ■ , .9. The s-values increase 
from top to bottom. 

Figure 14- The limiting function T(y) — y, Eq. ( |A13| ), s = .55. 

Figures 15-20. The incomplete functions T n (y) — y, Eq. (|A12|) , n = 1,3,5 and n = 
96, 98, 100 with the boundary conditions T (y) = T 101 (?/) = y and s = .55. 



30 



FIGURES 




31 




FIG. 2. 



32 



0.1 



1.1 



11 



10 



01 



0.0 



1.0 



00 



FIG. 3. 



33 



n 1 

U. 1 


1 1 


0.0 


1.0 



11 



10 
01 



FIG. 4. 



34 




FIG. 5. 



35 



10 



10 



10 



-10 



10° $ 








20 



>/L- 



/ 



/ 



/ 



/ I > 

I I 
I < 



I 



/ 



LI 



40 60 

n 



80 



100 



FIG. 6. 



36 




FIG. 7. 
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